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Web Content Adaptation Process and System 

Technical Field 

The present invention relates to an apparatus and method for adapting web page 
5 content for display on an intended display device, by splitting the content into a plurality of 
smaller web pages. 

Background to the Invention and Prior Art 

To deliver web content to different devices is a process of understanding, re- 

10 structuring and tailoring the content in such a way that the content source can be 
understood and delivered to different devices (such as desktop PCs, PDAs, and mobiles 
phones) in a manner which suits the device characteristics. Within the prior art (see for 
example Current Technologies for Device Independent, Mark H Butler, HP Labs Technical 
Report HPL-2001-83 4 April 2001), there are three presently known ways of doing it: 

15 Firstly, web developers/authors can use web page development software to tailor 

the content manually to suit different devices, at the web content development stage. By 
doing this, different versions (e.g. HTML/CSS, WML, XML/XSL) of a single source can be 
created based on the device capabilities. This approach is the primitive way to deliver web 
content to different devices, and is a time-consuming and tedious task for web 

20 developers/authors if a large number of versions are required. 

A second more automated approach is to use a proxy-based trans-coding approach 
through a proxy server which does the adaptation work on the fly when an end user submits 
an URI link through a HTTP request. This approach is computing intensive at the proxy 
server, and has the result that the system response time is slowed. Furthermore, there is 

25 no intervention of the original web developers/authors to the adapted web content, which 
may raise legal and copyright issues in some countries. 

A third known technique is to use a client-based (end user device) adaptation 
approach by installing the adaptation system software at the client side. The client-based 
adaptation system will adapt the web content on the fly after it receives the result sent back 

30 by the requested web server. This approach is computing intensive at the client side, which 
will consume and degrade the client processing performance. Again, there is no 
intervention of the original web developers/authors to the adapted web content, which might 
raise legal and copyright issues as well. Furthermore, this approach is not possible to be 
applied in small mobile devices due to computation power limitations. 
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As part of the adaptation, it may be necessary to split a page of web content into a 
plurality of smaller pages (known as content splitting), in view of the small size of client 
display devices such as PDAs and WAP phones. For example, to render the contents of a 
PC web-page (e.g. 800x600 pixels) to a smaller display (for example a PDA with 240x320 
5 pixels) in a readable form, it is desirable to adapt the content to fit into the fewest number of 
smaller pages whilst also trying to minimise the amount of white space. 

Prior known methods for content splitting include those described in US Patent 
Application No. 09/942.051 (published as US 2003/0050931 A1). entitled "System. 
Method and Computer Program Product for Page Rendering Utilizing Transcoding" 

10 This document describes a system which is able to adapt web content for display on 
different viewing devices by splitting the content into multiple pages. The system firstly uses 
the web content to construct a hierarchical tree structure using XML, which is then 
formatted for display on the device (e.g. by changing to a text font which is supported by the 
viewing device, and replacing redundant information with references to variables). The 

15 formatted structure is then split into multiple pages for output to the viewing device. 
However, whilst such an approach achieves the objective of splitting the content to fit the 
client display device, it does not satisfy the desirable objective of minimising the amount of 
white space. 

In view of the above, there is a need for a further approach which adapts web page 
20 content for display on an intended display device which does not possess the 
disadvantages of the prior art, and in particular with regards to attempting to minimise the 
amount of white space which will be displayed with the content. 

Summary of the Invention 

25 In order to meet the above, the present invention provides an apparatus and 

method for adapting web page content for display on an intended device. Here, an 
integrated process of splitting combined with transformations are provided in an iterative 
manner to adapt the content display size. This allows the content to be split into a suitable 
number of smaller web pages whilst keeping to a minimum the amount of white space that 

30 will be shown on the pages. In this context it is understood that the term "transformation" 
can include, for example, reducing / increasing the size of images / text, removal / 
replacement of content, etc. 

According to a first aspect of the present invention, there is provided an apparatus 
for adapting web page content for display on an intended display device, comprising 
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adaptation means for splitting the content into a plurality of smaller web pages for display on 
said device, the adaptation means being arranged in use to: 

(i) split the content into a plurality of content portions, and to iteratively repeat steps 
(ii) to (vi) for at least one of the content portions: 
5 (ii) analyse the content to determine whether the size of the content portion is 

suitable for display on said device; 

(iii) if the size of the content portion is not suitable for display on said device, then 
apply a plurality of transformations to the content portion; 

(iv) analyse the transformed content to determine whether the size of the 
1 0 transformed content portion is suitable for display on said device; and 

(vi) if the size of the transformed content portion is not suitable for display on said 
device then split the content portion into a plurality of further content portions. 

According to a second aspect of the present invention, there is provided a method 
15 for adapting web page content for display on an intended display device, comprising 
splitting the content into a plurality of smaller web pages for display on said device by 
performing the following steps: 

(i) splitting the content into a plurality of content portions, and iteratively repeating 
steps (ii) to (vi) for at least one of the content portions: 
20 (ii) analysing the content to determine whether the size of the content portion is 

suitable for display on said device; 

(iii) if the size of the content portion is not suitable for display on said device, then 
applying at least one content transformation to the content portion; 

(iv) analysing the transformed content to determine whether the size of the 
25 transformed content portion is suitable for display on said device; and 

(vi) if the size of the transformed content portion is not suitable for display on said 
device then splitting the content portion into a plurality of further content portions. 

According to a third aspect of the present invention, there is provided a computer 
30 program or suite of programs so arranged such that when executed by a computer system 
it/they cause/s the system to perform the method above. The computer program or 
programs may be embodied by a modulated carrier signal incorporating data corresponding 
to the computer program or at least one of the suite of programs, for example a signal being 
carried over a network such as the Internet. 
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Additionally, from a yet further aspect the invention also provides a computer 
readable storage medium storing a computer program or at least one of suite of computer 
programs according to the third aspect. The computer readable storage medium may be 
any magnetic, optical, magneto-optical, solid-state, or other storage medium capable of 
5 being read by a computer. 

The aspects of the invention as set out above and as described by the accompanying 
claims and any preferred features as set out herein and in the claims may be combined in 
any appropriate combination apparent to those skilled in the art. 

10 

Brief Description of the Drawings 

Further features and advantages of the present invention will become apparent 
from the following description of an embodiment thereof, presented by way of example only, 
and by reference to the accompanying drawings, wherein like reference numerals refer to 
1 5 like parts, and wherein: 

Figure 1 is a system block diagram illustrating the components of the embodiment 
of the invention, and the signal flows therebetween; 

Figure 2 is a process flow diagram illustrating in more detail how information flows 
between the components of the embodiment of the invention in operation; 
20 Figure 3 is a flow diagram for an algorithm to detect characteristics of display 

objects in web content within the embodiment of the invention; 

Figure 4 is a decision tree to detect the functions of display objects in web content 
within the embodiment of the invention; 

Figure 5 is a flow diagram illustrating how content transformations can be applied 
25 in the embodiment of the invention; and 

Figure 6 is a flow diagram illustrating how the process of content splitting is 
performed in the embodiment of the invention. 

Description of the Embodiment 
30 An embodiment of the present invention will now be described with reference to 

Figures 1 to 6. 

Figure 1 is a system block diagram of the system provided by the embodiment of 
the invention. This system consists of 8 sub-components, as described next. The full 
operation of the system will be described later. 
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Firstly there is provided the client capability discovery module 12. The purpose of 
this module is to discover the end user's device characteristics e.g. the type of device(s) 
and the device capabilities such as screen size/resolution supported, processing power etc., 
and as such this module receives information from the end user display device relating to its 
5 capabilities. The client capability discovery module 12 passes the end user's device 
information to the Decision Module 14. 

The Decision module 14 contains existing Client Capabilities profile Ids which were 
previously detected or predefined by the adaptation system. Client Capabilities profile Ids 
are sets of information relating to display device display characteristics. In use the Decision 

10 module 14 first compares an end user's device characteristics and capabilities (CC) range 
based on the information sent by the Discovery Module with the existing capability profiles. 
If the client capabilities match an existing profile, then the profile Id of the matching profile is 
sent to a content Cache 10 , in which is stored different versions of pre-generated adapted 
web content. If the received CC set does not match an existing CC range (i.e. there is no 

15 existing CC profile which matches the present requesting device capabilities) then the 
Adaptation module 16 will be triggered. Additionally, the adaptation module 16 may also be 
triggered manually to generate different versions of the original web content, without there 
being a specific request from an end-user. 

Howsoever the adaptation module 16 is triggered, the adaptation module 16 then 

20 acts to examine the http header of the requested web content, and further acts to control a 
content analysis module 20 to retrieve the requested web content from a web content 
source store 22. The content analysis module 20 then acts to analyse the indicated web 
content from the content source store 22, and passes back to the adaptation module 16 a 
range of parameters relating to the characteristics of the web content as input values to the 

25 adaptation module 16. The input parameters received at the adaptation module 16 from the 
content analysis module 20 enable the adaptation module 16 to adapt the requested web 
content from the original web content stored in the web contents store 22. The output of the 
adaptation module 16 is therefore an adapted version of the originally requested web 
content, and this is sent in an appropriate mark up language such as html to a content 

30 cache 10 together with a set of client capability (cc) information, being a set of one or more 
characteristics of the display of the device requesting the web content. Such display 
characteristic information was determined by the client capability discovery module 12, as 
previously described. 

In addition to the modules mentioned above, there is also provided, as previously 

35 mentioned, a content cache 10 which acts to store different adapted versions of the original 
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web content. In some embodiments, the cache 10 may also store client capability 
characteristics, being the set of information relating to the display characteristics of different 
client display device. Also provided is the content source 22, in which the original web 
content to be adapted is stored, and a content tidy module 18 which acts under the control 
5 of the content analysis module 20 to tidy up the original web content received from the 
content source store 22 prior to the analysis thereof. Furthermore, a customisation module 
24 is also provided which is merely a front end system providing previews of the adapted 
web content from the content cache. The customisation module 24 is an offline module 
which allows the author to preview and further customise adapted content. 

10 Having described the various system modules provided by the embodiment of the 

present invention, the operation of those modules will now be described in further detail with 
respect to Figures 2 to 6. 

The apparatus provided by the present invention would most likely be embodied in 
a computer system acting as a web server or the like. Alternatively, the apparatus can be 

15 embodied in a plurality of computer system components (as shown in figure 1) which can be 
embodied in separate computer systems. Preferably, one of the computer systems acts as 
a web server to other computer systems. Howsoever the apparatus is embodied, the 
computer system not only acts as a mere server, but also allows for the web content author 
to develop the web content and review it thereon. Moreover, the system also acts to 

20 generate different versions of the original web content for different intended display devices. 

In view of these functions, there are three distinct modes of operation of the 

system: 

a first mode wherein it is acting to sen/ice user requests for web content, the 
request having been received over a network; 
25 a second mode wherein it acts to generate adapted versions of the web content for 

different intended display devices in advance of the receipt requests from users for such 
web content; and 

a third mode wherein adaptation of web content to provide a further adapted 
version can be performed on the fly in response to a user request. Each of these modes of 
30 operation will now be described. 

Dealing with the second of the above described modes of operation first, imagine 
that the system is being used to generate different versions of original web content in 
advance of user requests therefor. For example, this mode could be used during website 
development to provide versions of an original source web content each especially adapted 
35 for different intended display devices, each with different display characteristics. 
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Therefore, when in this mode the first step to be performed is that a plurality of sets 
of predefined intended display device display characteristic profiles are created, each set 
having a unique ID, and corresponding to a set of one or more display characteristics, each 
characteristic taking a range of values. For example, a first client capability profile set could 
5 have fields entitled client Ltype screen^resolution, and colour_depth. A first profile ID CC1 
would by way of example have the value "PC" in the clientjype field, the value "800 x 600" 
or "1024 x 768" in the screen_resolution field, and "16bits" in the colour_depth field. As a 
further example, a further client profile set with the ID "CC2" could have the value "PDA" in 
the clientjype field, the value "200 x 300" in the screen_resolution field, and the value 

10 "32bif in the colour_depth field. It will be understood that the above are merely non limiting 
examples of the type of information which can contribute towards the profile sets and that a 
large number of different profiles can be easily created by forming a collection with different 
combinations of device characteristics and capabilities. Once created, the client capability 
profile sets are stored in a profile server 26, as shown in Figure 2. This is merely a 

15 database system which acts to physically store the device profiles. The profile server 26 is 
accessible by the decision module 14 in order to allow the decision module to compare 
requesting user display device characteristics with the stored client capability profile sets. 

Having created a plurality of client capability profile sets each with a different 
combination of intended display device characteristics and values, in the mode of operation 

20 presently described the system acts to then generate an adapted version of the original 
source web content for each of the client capability profile sets stored in the profile server 
26. This is performed by triggering the adaptation module 16 to adapt the original source 
web content to match each client capability profile set. The adaptation module 16 will 
usually be triggered separately for each client capability profile set, such that on any one 

25 triggering, a single adapted version of the web content corresponding to a single client 
capability profile set will be generated. The detailed operation of the adaptation module 16 
upon triggering is given below. 

The first step performed by the Adaptation Module 16 is to trigger the Content 
Analysis module 20, by passing to it details of the original source web content to be 

30 adapted. The Content Analysis module 20 then retrieves the original content source from 
the Content source store 22 (which stores all the web content source created by 
developers/authors), and passes the retrieved content source to the Content Tidying 
module 18 for conversion to an xHTML file. The function of the Content Tidying module 18 
is to tidy up the structure of the mark-up language (web content) and convert it into xHTML 

35 structure format. xHTML format provides a neat and tidy structure for the Content Analysis 
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module 20 to perform the analysis task. The Content Tidying module 18 can be provided by 
using 3 rd party software such as TIDY, available at the priority date from 
h6p://tidy.sourceforge.net/. As such, no further details of the operation of the content tidying 
module 18 will be given here. The Content Tidying module 18 passes back the tidied 
5 xHTML file to the Content Analysis module 20. 

Having received the tidied web content, the Content Analysis module 20 then 
performs the following tasks in sequential order: 

i) calculates the total and individual pixels and characters of display objects in the 

web content; 

10 ii) detects the functions of individual objects in the web content (normally they are 

the tags in a web page). For example, an object may possess a styling, structural or display 
tag; 

iii) groups single objects based on their structural behaviour (information from 
object tag); and then 

15 iv) matches the display object display patterns, and groups them together to form a 

group (performed using a Pattern Matching algorithm). 

These four tasks are performed by respective dedicated algorithms, the details of 
which are given next. 

Concerning the first task, the purpose of this is to calculate the pixels/size of 

20 display objects such as text, image and etc. The algorithm which performs this task will first 
detect the type of display object. The algorithm then applies different analysis logic for 
different type of display objects. For example, if the display object is a text object, then it 
gets the length, font style and size and calculate the pixels based on these input. If the 
display object is an image/applet/object, then the algorithm will calculate total pixels based 

25 on width and height of the object. For the rest of the display objects, the algorithm will 
calculate total pixels based on the width, height and/or width/height attributes set in the 
parameter of the object (if it is specified in the HTML content). The exact steps performed 
by this algorithm are shown in Figure 3, and described next. 

Referring to Figure 3, the first step to be performed by the algorithm at step 3.2 is 

30 that it detects an individual display object within the tidied web content. Then, at step 3.4 an 
evaluation is made to determine whether or not the detected display object is text. If this 
evaluation returns positive, such that the detected display object is determined to be text, 
then at step 3.6 the length of every text string within the display object is obtained. Next, at 
step 3.8 a text tag is created for every string, and at step 3.10 the numbers of characters in 

35 the string determined at step 3.6 is set as an attribute of the text tag. 
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Next, at step 3.12 the font and style of every text string is determined, and then at 
step 3.14 the size of every text string is also determined. Using this information, at step 
3.16 the height and width of the text string based on their font, style, and size attributes is 
calculated and these calculated height and width values are set as further attributes of the 
5 text tag for each string at step 3.18. The process for that particular display object which 
was determined to be text then ends at step 3.50, and the process starts once again at step 
3.2 to detect the next display object in the web content. Once all of the display objects have 
been processed by the algorithm, then the algorithm is not repeated. 

Returning to step 3.4, if it is determined herein that the detected display object is 

10 not text, then a second evaluation is performed at step 3.20 to determine whether the 
detected display object is an image, applet, or object. If this evaluation returns positive, i.e. 
that the display object is an image, applet, or object, then processing proceeds to step 3.22 
wherein a further evaluation is performed to determine whether or not the width of the 
image, applet, or object is specified. If this is the case then processing proceeds to step 

15 3.24. If this is not the case, then processing proceeds to step 3.28, wherein the original 
width of the object is determined, and thereafter processing also proceeds to step 3.24. 

At step 3.24 a further evaluation is performed to determine whether or not the 
height of the detected image, applet or object is specified. If this evaluation returns positive 
then processing proceeds to step 3.26. On the contrary, if the evaluation of step 3.24 

20 returns a negative, then processing proceeds to step 3.30 wherein the original height of the 
object is determined. Processing then proceeds from step 3.30 to step 3.26. 

At step 3.26, the width and height attributes of the image, applet, or object as 
determined by the previously described steps are set as the width and height attributes of 
the object tag within the web content. Following this, the processing of that particular 

25 display object then ends at step 3.50. As before, if further objects need to be processed 
then processing begins again at step 3.2. 

Returning to step 3.20, if the evaluation performed therein determines that the 
detected display object is not an image, applet, or object, then processing proceeds to step 
3.32, wherein an evaluation is performed as to whether the width and height of the detected 

30 display object are specified. If this is the case, then processing proceeds to step 3.34 
wherein the specified width and height are set as parameters in the style attribute of each 
control tag for the detected display object. The processing then ends at step 3.50, and may 
be repeated if required as described previously. 

If at step 3.32 it is instead determined that neither the width nor the height are 

35 specified, then processing proceeds to a further evaluation at step 3.36, wherein it is 
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determined whether or not the size of the detected display object is specified. If this is the 
case, then processing proceeds to step 3.34 wherein the size is set as a parameter in the 
style attribute of each control type for the object. Again, processing then proceeds to step 
3.50 where it ends, but may be repeated if there are further display objects to process. 
5 Finally, if the evaluation at step 3.36 returns a negative, then a final evaluation at 

step 3.38 is performing to determine whether or not a value of a detected display object is 
specified and if so then the specified value is set as parameters in the style attribute of each 
control type for the object at step 3.34. On the contrary, if no such value is specified then 
processing proceeds to step 3.40 wherein a default width and height of each control is 
1 0 retrieved from memory, which are then set as default values at step 3.34. 

This algorithm therefore acts to determine for each display object within the tidied 
web content size parameters such as the length of a text string, or the width and height of 
an image. This information may then be used in the adaptation process, to be described 
later. 

15 Concerning the second task, a further algorithm is provided to perform this task, as 

described next. 

First the algorithm to perform the second task pre-defines the function categories of 
single objects from a mark-up language perspective. A Single Object (O) is an element 
embedded in a mark-up language which carries properties of its own such as display styles, 
20 static or dynamic and structural styles. 

We define the following pre-defined categories: 
Information (I) 
Information Title (T) 
Control (C) 
25 Decoration (D) 

Replaceable Navigator (RN) 
Un-replaceable Navigator (UN) 
Replaceable Navigator Title (RNT) 
Un-replaceable Navigator Title (UNT) 
30 The definitions of these function categories are as follows: 

Information (I) - an object that provides informative displayed content, which is 
important and cannot be replaceable. This object can be text, image, video, audio or any 
object (such as JAVA applet) file. 

Information Title (T) - an object that describes the information object, which can be 
35 the text header or image with information properties. 
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Control (C) - an object that is meant for user interactive purposes, such as a button 
(radio or submit), input text area, form, drop down menu, check box, list box etc. 

Decoration (D) - an object that does not play an informative role but is solely for 
improving the effect of visualisation. This object can be image or text. 
5 Replaceable Navigator (RN) - a Navigator is a URI link object. A Replaceable 

Navigator is a Navigator object that can be replaced by alternative text. It must be an image 
provided with alternative text. 

Un-replaceable Navigator (UN) - as mentioned, a Navigator is a URI link object. 
An Un-replaceable Navigator is therefore a Navigator object that cannot be replaced by 
1 0 alternative text. It might be text or image without alternative text. 

Replaceable Navigator Title (RNT) - A replaceable navigator title is the informative 
URI link object which describes a Navigator object. It can be replaced by alternative text. It 
must be an image provided with alternative text. 

Un-replaceable Navigator Title (UNT) - This is an informative URI link object which 
15 describes a Navigator object. It cannot be replaced by alternative text. It might be text or 
image without alternative text. 

By providing such pre-defined function categories, the algorithm starts a scanning 
and comparing mechanism that analyses the properties of single objects embedded in a 
mark-up language (such as HTML). The reasoning of the analysis is based on a decision 
20 tree (scanning and comparison logic sequence), as shown in Figure 4. 

The algorithm begins by scanning the web content mark-up language from top to 
bottom. When the scanning process starts, every single object of the mark-up language is 
searched, detected and compared with the pre-defined function categories. This comparing 
process is carried out until end of the mark-up language. 
25 Within the scanning loop, the algorithm searches for single objects and determines 

their function based on the properties carried by the object. The algorithm stops comparing 
the single object (On) properties and searches for the next single object (On+J) after the 
first single object On has qualified for a particular function category. 

Referring to Figure 4, the decision tree process applied by the algorithm is as 
30 follows. The algorithm starts by first searching for a single object. Once a single object 40 
has been detected, the algorithm then checks at step 4.2 as to whether the detected object 
has hyperlink properties embedded therein. 

If the object has hyperlink properties, then a check is performed at step 4.4 to 
determine if the object is replaceable by finding whether there is any alternative text for the 
35 object. If there is alternative text and title properties for this object (as determined by step 



WO 2005/033969 



12 



PCT/GB2004/004151 



4.6), then this object is categorised as a Replaceable Navigator Title (RNT) 48. Else if there 
is alternative text but no title properties for this object, then the algorithm categorises this 
object as a Replaceable Navigator (RN) 46. 

If there is no alternative text and title properties for this object, then the algorithm 
5 categorises this object as an Un-replaceable Navigator Title (UNT) 52. Else if there is no 
alternative text and no title properties for this object, then the algorithm categorises this 
object as an Un-replaceable Navigator (URN) 50. This distinction is evaluated at step 4.16. 
The title properties of RNT and UNT are based on the following conditions: 

It has title header properties; and 
10 It is a display object; and 

It must be URI hyperlink (image or text); and 

It has different styles compared to its adjacent display object. 

After comparing the object with the hyperlink properties at step 4.2, 4.4, 4.6, and 
4.16, if the object has not yet been categorised the invention will route the checking logic for 
15 non-hyperlink properties. User side interaction properties are the next to be compared. 
The factors that determine if the single object has user side interaction properties are if the 
single object is one of the following: button (radio or submit), input text area, form, drop 
down menu, check box, or list box, and an evaluation to this effect is made at step 4.8 

If the single object is detected at step 4.8 as having user side interaction 
20 properties, it will be categorised as a Control (C) 42. Else, the algorithm will further 
compare if it is an object which carries video, class object or audio properties, at step 4.10. 
If it is, then this single object will be included in the Information (I) function category 44. 

If the object has still not been categorised, the algorithm further checks the single 
object by determining if there are decoration properties carried by the single object at step 
25 4.12. The decoration properties are determined based on the following criteria: 

The size of the single object - The size of the single object is derived from an 
experimental value which best represents the size of decoration properties; or 

The presence of symbols, lines and separators between the present single object 
(On) and the next single object (On+1). 
30 The object size (width & height) is based on experimental value (subjective value). 

The inventors performed experimental tests on 100 web pages, and our results showed that 
images with pixel sizes width <= 20 and height <=20 tended to be a decoration object. 

If the present single object qualifies from the above conditions, it will be 
categorised as a Decoration (D) function 54. If there are no decoration properties found 
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within the single object, the invention will further check for information title properties, at 
step 4.14. 

Once the single object is determined as not having decoration properties, it will be 
either categorised as Information function or Information Title function at step 4.14. The 
5 single object will only be qualified as Information Title (IT) 58 based on the following criteria: 
It has title header properties; and 
It is a display object; and 
It might be text or image only; and 
It has different styles compare to its adjacent display object. 
10 If the single object is determined not to have the title properties, it will be 

categorised as an Information (I) function 56. 

Therefore, as will be apparent from the above, based on the scanning process and 
comparing mechanism done by this algorithm, all of the single objects in the tidied web 
content obtain an assigned specific function to represent their role within the mark-up 
15 language, thus fulfilling the second task performed by the content analysis module 20. 

Regarding the third task, a further algorithm is provided within the content analysis 
module to perform this task. The main purpose of this third algorithm is to group content into 
clusters based on their positioning information. Structural tags represent this information. 
The structural tags we recognise and select are: 
20 <TABLE>, <FORM>, <FRAMESET>, <DIV>, <UL>, <OL>, <DL>, <P>, <PRE>, 

<ADDRESS>, <BLOCKQUOTE>, <Hn>, <HR>, <CENTER>, <MENU>, <DIR>, 
<TD> and <NOSCRIPT>; 

which were selected for clustering objects because they are able to group objects 
together visually when the objects are displayed on client browsers. 
25 The operation of the algorithm which performs this task is simple, and merely acts 

to parse the web content and select objects for grouping on the basis of the presence of any 
of the above tags within the object. 

With respect to the fourth task, i.e. that of matching the display object display 
patterns, and grouping them together to form a group, a pattern matching algorithm is 
30 provided, as described next. 

Web pages can be thought of as comprising of a number of content chunks. These 
chunks are sets of multimedia objects that relate to particular areas of interest or tasks. If a 
basic object is defined as one that contains a single multimedia element (for example an 
image or a body of text), and a composite object is defined as a set of objects (basic or 
35 composite) that perform some certain functions together, then a chunk is itself a high-level 



WO 2005/033969 



14 



PCT/GB2004/004151 



composite object. When a web-page is split up into a number of smaller pages it is 
important for the intelligibility that the content chunks are not broken up. Thus, before 
adapting the content, the multimedia objects that make up the page need to be grouped into 
potential chunks. 

5 Yang and Zhang of Microsoft Research have described a system for locating such 

content chunks, in Yang, Y. and Zhang, H.J. "HTML Page Analysis Based on Visual Cues" 
In 6 th International Conference on Document Analysis and Recognition (ICDAR2001), 2001. 
The following paragraphs outline a similar system. Both systems use the HTML tags to 
perform an initial grouping of multimedia objects into possible composite objects, followed 
10 by application of pattern matching to find possible further groupings. The difference 
between the systems lies in the distance measure used to determine the similarity of 
various objects and the algorithm for pattern matching. 

Initial grouping of objects 

15 Before performing the initial grouping of multimedia objects into possible composite 

objects, the HTML document is parsed into an xHTML tree to clean up the HTML tags and 
to form an easy to manipulate structure. The xHTML tree consists of HTML tags at the 
nodes and multimedia objects at the leaves. 

The next step involves the construction of a group tree, in which the leaves contain 

20 multimedia objects and nodes denote composite objects (and so potential content chunks), 
up to the top node which denotes the entire web-page. The xHTML tree is transformed into 
a group tree, by first inserting <g> tags directly above a predefined set of HTML tags 
associated with the natural breaks in the content, mainly block level tags, such as <table>, 
<td>, <form>, <center> and <h>. Second, a set of tokens, one for each type of multimedia 

25 object is defined along with sets of attributes, for example, the number of characters in the 
text string, or the width and height of the image. Third, working from the multimedia objects 
at the leaves in the tree, the tokens are passed upwards and all nodes other than the leaf 
and those containing <g> tags are removed. As a token is passed upwards it accumulates 
attributes associated with the nodes, if a node has more than one child then all the children 

30 receive the attribute associated with it. Some formatting tags, such as <tr>, are ignored 
since they to not impose any attributes onto the multimedia elements and unlike the tags in 
the predefined set are not usually indicative of a new content chunk. If a <g> tag node has 
more than one child then the tokens arranged in a linear list in the same left-to-right order in 
which the child nodes are arranged. 
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By labelling the objects associated with various block-level tags, such as tables 
and cells, as potential groups; the group tree already incorporates the majority of the 
composite objects and so content chunks. This technique assumes, not always correctly, 
that the <g> tags do not split any content chunks. However, labelling the contents of 
5 formatting objects does not distinguish between content chunks which are implied through 
repeated arrangements of similar multimedia objects. Thus, once the group tree has been 
derived, pattern matching is performed on the list of tokens belonging to the child nodes of 
each <g> node. 

10 Pattern Matching 

The first step in the pattern matching process is determining which of the lists of 
tokens in each of the child nodes are similar. Note that each token has a set of attributes 
associated with it. Each attribute consists of a type and a value pair, for example (font, 14pt) 
and (width, 100). The values can either be strings or integers. If an attribute type does not 
1 5 naturally have a value associated with it then the value is set to a null string, for example 
(bold, ). When comparing tokens, if a particular token does not have any attributes 
associated with it, then it is assigned a special null attribute ( , ) to ensure that the set of 
attributes is not empty. 

To compare two tokens, a and 3, with the sets of attributes: (r/'.v/ 1 ), i = l N a 

20 and (r/.V/), ; = l N fi the following similarity measure is used 

U=' /* )l 

where i) fa ,V?)1p 0 if 3 is j*N p such that T t a =Tf and v 9 a =Vf 

ii) fa , V? )tp p , V * )= minfa , Vf )/maxfa , Vf ) if 3 \<j<,N fi such that T t a = Tf and both of 
Vf and Vf are integers 
25 Hi) fa 9 Vf^ § V p )^0 otherwise. 



Comparison of lists of tokens is achieved by dynamic time warping (a dynamic 
programming algorithm), see table 1 below, in which the alignment path is not allowed to 
wander more than a given number (proportional to the length of the smallest token) places 
30 off the diagonal and also incorporates a punishment for non-diagonal movements. If the 
sum of the similarity measures along the alignment path is greater than a threshold the two 
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lists of tokens are regarded as similar since they are either identical or if there is only a little 
variation in their length and composition. 

5 Public boolean Compare (ArrayList A, ArrayList B) 

float M[] [] = new float [A. size () +1] [B. size O+l] ; 
float Allow = 0.55 // acceptable average gain per token 
float P = 0.3; // punishment for non-diagonal transitions 
10 for (x=l;x<=A.size() ;x++) 

{ 

for (y=l;y<=B.size() ;y++) 

if ((x-y)<=2 && (x-y)>=-2) // if with 2 of diagonal 
15 M[x] [y] = Max(M[x-l] [y-l],M[x-l] [y]-P,M[x] [y-1] -P) 

+ S(A.get(x-l) ,B.get (y-1) ) ; 
} 

} 

if (M[A.size()] [B.sizeO] >Min(A.size() ,B.size() )* Allow) 
20 return true; 

else return false; 
} 

Table 1 . JAVA code for the comparison of lists of tokens. 

25 To detect patterns, a lower triangular matrix, minus the diagonal elements, is first 

constructed detailing which of the child nodes (lists of tokens) are similar to one another. 
Next the significant token pattern, that is the repeated sequence of similar nodes that 
covers the largest number of child nodes, is found by examining all possible patterns. The 
significant token pattern denotes the start of each new group. 

30 To prevent trivial significant token patterns emerging a number of constraints are applied, 
namely: 

The pattern must be at least two child nodes in length; and 

The pattern must be repeated at least twice; and 

Instances of the same pattern should not overlap. 
35 As these significant tokens denote the start of the groups (or content chunks), the 

groups are themselves extended by adding the following child-nodes into the groups whilst 
ensuring non-overlapping and reasonable similarity amongst the groups. 

The above concludes the four tasks performed by the content analysis module 20. 
After these tasks, the system will have constructed an XML tree based on the retrieved web 
40 page content. This tree includes various additional information about the web content, and 
is now in a format suitable to be passed to the Adaptation Module. The information which 
has been provided by this process relate to: 
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i) Unbreakable groups which are not supposed to be separated during adaptation 
(i.e. the "chunks" referred to above); 

ii) the functions of groups and single objects, which indicate whether they can be 
5 ignored or removed; 

iii) the total display pixels and characters of the content source, which are used by 
the Adaptation module when deciding whether/how to split the content into smaller pages; 
and 

iv) The original structural and styling information of the content source. Here, 
10 structure means the layout of content. Structural information contains codes of how the 

content is arranged and positioned. Style means content objects' (such as text or image) 
width, height, colour, font attributes (e.g. font-face and size), etc. 

The format of the XML tree which has been produced by this process is such that it 
now includes identifiers (known as <g> tags) which identify where it is allowable to split the 

15 content for display on separate web pages. Multiple <g> tags have been inserted, as 
discussed earlier, based both on natural breaks in the content (e.g. block level tags such as 
<table>,<td>,<form>,etc) and also based on appropriate groups of content which should be 
displayed together. The hierarchical tree format means that these <g> tags form a number 
of nodes indicating where the tree may be split, and therefore the lowest <g> tags (i.e. 

20 those closest to the leaves) indicate those nodes below which no content splitting is allowed 
(i.e. unbreakable groups of content which cannot be spread over different web pages). 

An additional aspect of the XML tree is that it includes a second type of identifier. 
These identifiers are labels associated either with individual content objects (i.e. single 
multimedia elements such as an image or body of text) or composite objects (a set of 

25 objects which perform certain functions together). Those objects which are similar, for 
example of the same type and with similar lists of style attributes and other characteristics 
(such as image size or number of text characters) are labelled with the same identifier tag. 
During the adaptation process (described later) these labels are used to ensure uniform 
treatment of similar objects when they are being processed for display on a web page (e.g. 

30 that all similar images / text boxes are reduced by the same proportion). 

As mentioned, the Content Analysis module 20 now passes the results of the 
analysis ( the XML tree) to the Adaptation module 16. The Adaptation module 16 then 
retrieves all the client capability device profiles available (and which in this mode of 
operation were pre-generated) from the Profile Server 26. The Adaptation module 16 then 

35 triggers loops which run an algorithm to generate different versions of web content based 
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on the profiles available. The number of loops performed will depend on the number of 
profiles available. Essentially, an adapted version of the content is generated for each client 
capability profile. 

The algorithms that operate on the XML tree to adapt the content are illustrated in 
5 the flow charts in Figures 5 and 6. Figure 5 shows the algorithm which checks whether the 
content will fit into the current profile range for the display device. This algorithm cycles 
through a number of stages, checking each time whether the content will fit the page (i.e. 
the display device), and if not then it performs a number of transformations to progressively 
reduce the size of the content. The algorithm of Figure 5 forms just one of the stages of the 
10 algorithm shown in Figure 6, which further operates to split the content onto different pages 
(if necessary). 

Starting with the algorithm of Figure 6, the purpose of this is to ensure that if the 
content is too large for display on a single page on the intended display device, then it is 
split into multiple smaller pages, whilst minimising the amount of white space on the pages. 

15 To perform the splitting, the algorithm uses the <g> tags in the XML tree structure. The 
algorithm operates by moving through the tree from node to node (the nodes tagged with a 
<g> label) starting from the top <g> node. At each node, the algorithm calculates whether 
the content in the sub-trees below it will fit the display, applying transformations to the 
multimedia objects (such as shrinking the font size / image size) as appropriate. If the 

20 content below the current <g> node will not fit the display, then the algorithm moves down 
to the child <g> nodes and recalculates for each of those (splitting them further if 
necessary) until the whole web page has been output as multiple smaller web pages. 

In more detail, with reference to Figure 6, the steps carried out by the algorithm are 
as follows. Two temporary stores, stacks "Q" and T, are used to temporarily store the 

25 nodes during processing. A third store, array "Trans", is used to store data relating to the 
transformations (such as reduction of the font size, or image size) which are to be applied to 
the various objects in the web page. 

The adaptation algorithm commences at step S6.1. Firstly, the algorithm takes the 
top <g> node from the tree and puts it into stack Q (step S6.2). The algorithm also ensures 

30 that the temporary stack T is cleared (step S6.3). The algorithm then moves to step S6.4, 
which calls the function fitsjpage(TJrans) t explained in more detail below, to check 
whether the <g> nodes currently stored in T will fit into the client display, and applies 
transformations to the multimedia objects as appropriate. However, since at this point the 
stack T is empty, fits_page(T,Tran$) will return TRUE, and processing moves onto step 

35 S6.5, which is to check whether all the nodes in T have the same parent, using the function 
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are_siblings(T). Since T is also empty, this returns TRUE, moving processing onto step 
S6.6, which checks whether there are any nodes remaining in stack Q. Since there are 
nodes in Q (the top <g> node is currently in Q), processing moves onto step S6.7 which 
moves the node from the top of stack Q onto stack T, and processing cycles back to step 
5 S6.4. 

At this point, the top <g> node of the tree is in stack T, so step S6.4 checks using 
function fits _page(T f Trans) whether this node (i.e. the web content of all the sub-trees 
below it) fit into the client device display, including applying transformations to the objects 
as appropriate. This step involves the algorithm illustrated in Figure 5. At this stage, the 

10 algorithm is checking whether the entire web page content will fit into the display device 
(because the node currently stored in T is the top node). If the content is small enough to 
fit, the algorithm will terminate by passing through step S6.5 to step S6.6 since there are no 
nodes remaining in stack Q, the process jumps to step S6.15 where it outputs the entire 
tree (using a call to the function render(T,Trans) ), and then ends. 

15 However, when the entire web page content will not fit into the display device, then 

step S6.4 will be negative, and processing moves to step S6.8 which removes the top node 
from stack T and stores it as node N. Then, at step S6.9, there are still no nodes in. stack T, 
so processing moves to step S6.10 which checks whether the node N is a leaf. At this 
stage, the answer is negative (because the node N is the top <g> node), so processing 

20 moves to step S6.1 1 which places all the direct child <g> nodes of node N onto stack Q for 
processing. Then, step S6.12 checks whether there are any nodes for processing in stack 
Q. At this stage, all the direct child <g> nodes of the top XML tree node are in stack Q, so 
processing cycles back to step S6.3 which clears the temporary stack T. 

Processing then moves through steps S6.4, S6.5, S6.6 and S6.7 which moves the 

25 first of the direct child nodes from stack Q to stack T. It may be this portion of the web 
content (i.e. the content in the sub-trees below this child node) is small enough to fit into the 
client display (i.e. step S6.4 returns TRUE). In this case processing again passes through 
steps S6.4, S6.5, S6.6 and S6.7 to add the second child node from stack Q to stack T. This 
process will repeat indefinitely, checking each time whether this combined portion of the 

30 content (i.e. of all the nodes added to stack T) still fits within the client display. If at any point 
the source content (i.e. the current portion of content represented by the list of nodes in T) 
will not fit the display (i.e. step S6.4 is negative) then processing moves to step S6.8 where 
the last node added to stack T (i.e. the node highest on the stack) is removed from stack T 
and stored as node N. Step S6.9 then checks whether there are still nodes remaining on 

35 stack T, and, if yes, processing moves to step S6.13 where the node N is returned to the 
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store it came from (i.e. stack Q) for processing later. Then a section of the XML tree (i.e. the 
content represented by the nodes currently in stack T) is output as one of the adapted 
smaller pages using a call to the function render(T,Tran$). The algorithm continues with 
S6.12 determining whether there are still nodes remaining in stack Q for processing, and, if 
5 yes, moves to step S6.3. 

Following the steps illustrated in Figure 6, the algorithm will iteratively work through 
the entire tree, transforming the content to see if it can be made to fit the display (i.e. in 
function fits_page(T,Trans)) and if not, then splitting the content even further. This is 
achieved in the algorithm by the process of: each time the content below a node does not fit 

10 into the display device then its direct child <g> nodes are separately added into a store (the 
queue in stack Q) in step S6.11 for processing later. This acts to split the content into 
smaller and smaller portions, so that the sub-trees can then be checked individually to see if 
the content is a suitable size for display on the client device. For any content portions that 
do fit the display, an attempt is then made to combine them with other portions of the 

15 content (i.e. step S6.7) so as to minimise the amount of white space in the display. 
However, this combining of different portions of the content is only made if the nodes in 
question are siblings (i.e. have the same parent <g> node in the tree). In this way, the 
adaptation algorithm works its way down through the entire tree, from the top <g> node to 
the bottom <g> node leaves (below which no further content splitting is allowed). 

20 By virtue of hierarchical tree arrangement of the web content in the XML tree, and 

the order of the steps performed by the adaptation algorithm, the top-to-bottom, left-to-right 
order of the content is maintained when it is displayed. Also, it ensures that only whole and 
related composite objects (of the same level of grouping) are displayed on a single page. 

In addition, the algorithm ensures consistency of display of similar objects 

25 throughout the smaller pages. It achieves this by the use of a store (e.g. the array called 
Trans) which maintains a list of transformations which have been applied to the objects, 
together with the object label associated with that object (i.e. the second type of identifier 
tag referred to earlier which indicates similar objects). For each portion of content, the 
algorithm checks array Trans to see if changes have already been applied to objects which 

30 were similar, so as to ensure that the transformations applied to these objects are 
consistent. The array Trans is dynamically updated during processing, each time the 
function fits_page() successfully applies new transformations to a portion of content that 
result in it fitting within the page size. 

It is to be understood that throughout the description of the adaptation algorithm 

35 above, reference has been made to two stores, stacks M Q W and T, used to temporarily 
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store the nodes during processing. For the purposes of the function of the algorithm, such 
stores can therefore be considered to hold the relevant portions of content associated with 
those nodes. This is true notwithstanding the fact that the stores themselves may actually 
be implemented simply as a list of memory addresses which point to the locations of the 
5 content in another part of the memory. 

An exemplary embodiment of the adaptation algorithm (pseudo java code) for 
adapting the web page is given below: 

split Page (top_node) 
10 { 

Stack Q ; // Q is a stack which holds the nodes to be processed 

Stack T; // T is a stack which holds nodes being processed 

Node N; // N is a temporary node 

ArrayList Trans; // Trans is an array which holds the transformations applied to 

15 / / objects according to their object/group labeling 

Q.push(top_node) // Add the top <g> node in the XML tree to stack Q 
while (Q.sizeO >0) 

{ 

20 while (IT.emptyO) T.popO; // Empty stack T 

while (f its _page (T, Trans) are — siblings (T) ) 

if (Q.size()==0) goto end; // Finished XML tree 
25 N=Q . pop ( } ; // Take the top node off stack Q... 

T . push (N) ; // ... and add it onto stack T 

} 



30 



N=T . pop ( ) ; / / Remove top node from stack T and store it as node N 



if(T.size()>0) // Checks whether there are any nodes in stack T 

{ 

Q . push (N) ; // node N is returned to stack Q for processing later 

Trans =render (T, Trans) ; // output a section of the XML page 
35 } 
else 
{ 

if (is_leaf(N)) Trans=render (N, Trans) ; // If the current node N is a leaf 

/ / then output a section of the XML page 

40 else 

{ 

for each child C of N in reverse order 

{Q.push(C);} // Put all the direct child <g> nodes of N 

// onto stack Q for processing 

45 } 

} 

• } 
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end : render ( T , Trans ) ; / / output the last part of the XML page 



5 

where the following functions are used by SplitPageQ: 
is teaf(N) 

This function returns TRUE if the temporary node N is a leaf 

10 

are siblings(T) 

This function returns TRUE if the nodes in stack T share the same parent <g> node 
(or T contains a single node or is empty) 

15 fits paae(T.Trans) 

This function determines whether the nodes in stack T (i.e. the content of all the 
sub-trees below those nodes) are small enough to fit into the display device. Firstly, if stack 
T contains any nodes with identifier labels the same as those in Trans, then the associated 
transformations are applied to those objects. If the content now fits the page then 
20 fitsjDage(T t Trans) returns TRUE. 

However, if the content does not yet fit the page, then a number of different 
transformations can be applied to the content, and these are illustrated in Figure 5. If any of 
these additional object transformations successfully result in the content fitting the display 
device then the transformations are added to the array Trans with the appropriate object 
25 labels, and fits_page(T t Trans) returns TRUE. 

Alternatively, if the source content will still not fit the display device, even after all 
possible additional transformations have been applied, then fits _j>age(TJrans) will return 
FALSE. 

This function will also return TRUE if stack T is empty. 

30 

render(N.Trans). render(TTrans) 

This function is used to output a portion of the content (i.e. the content represented 
by one or more nodes of the XML tree) as one of the adapted smaller pages. The function 
either has input parameters of node N and array Trans, or stack T and array Trans. Since 
35 Trans contains the identifier labels for object which have been rendered to date, along with 
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those transformations and parameters associated with them, then if N or T contains objects 
whose labels are the same as those in Trans, the relevant transformations are applied to 
those objects. The remaining objects are then transformed as appropriate (i.e. to fit the 
intended display device whilst minimising the white space), and the labels and 
5 transformations added to Trans. Finally Trans is returned by the function. 

As mentioned earlier, during the function call fits jpage(T, Trans), if the content 
does not fit the profile range (e.g. the intended display device), then a number of different 
transformations can be applied to the content, and these are now discussed in more detail 
10 with reference to Figure 5. The algorithm which carries this out performs the following 
checks: i) Check if the total pixels and characters of the source content can be fit into the 
profile range; 

ii) Check if after removing the blank spaces and lines, source content can be fit into 
the profile range; and 

15 iii) Check if removing, resizing, summarising, and changing properties of the 

display object will fit the source content into the profile. 

These checks are embodied by 8 possible transformations. These transformations 

are applied in order, but after each transform has been applied an evaluation is performed 

to determined if the content as transformed up to that point can be displayed on the 
20 intended device, by referring to the client capability profile for that device. If it is determined 

that display is possible then no further transformations are applied, otherwise all 8 

transformations are applied. 

The available transformations, in order, are as follows:- 

1 st transformation: Font reduction. Here the original font is transformed into a smaller font 
25 size with 'Verdana" as the font-family. 

2 nd transformation: Image reduction. The purpose is to reduce image objects by 10% and 

goes into recursion until it reaches the optimum size or 50%. 

3* transformation: Control object reduction. The purpose is to reduce objects based on the 
ratio of default screen size and client device if the result is greater than an optimum size of 
30 the object. 

4 th transformation: Space removal. The purpose is to get rid of those unnecessary space 
between paragraphs. 

5 th transformation: Line removal. Its purpose is the same as the 4 th transformation. 
6 th transformation. Decoration image removal. The purpose is to remove images which 
35 have decoration properties based on objects' size. 
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7 th transformation: Decoration text removal. The purpose is to remove redundant texts 
which act as decoration if they are special characters. 

8 th transformation: Image replacement. If there is an alternate text for an image, then the 
algorithm will compare the alternate text size with the image itself. The shorter will be 
5 selected as the adapted result. 

Figure 5 illustrates the transformation algorithm in more detail, and in particular 
illustrates the eight different transforms which may be applied. Referring to Figure 5, the 
procedure provided thereby is started at step 5.1 wherein two counters are initialised. More 
particularly, a first counter i is initialised to i=1 , and a second counter r is initialised to r=0. 

10 Next, processing proceeds to step 5.2, wherein an evaluation is performed to 

determine whether or not the web content will fit into the display of the intended display 
device. This evaluation is performed by comparing the characteristics of the content with 
the client device display capability characteristics as provided in the client capability 
profiles in the profile server 26. To generate a particular adapted version, at step 5.2 the 

15 evaluation is always performed against a single one of the client capability profiles, in 
respect of which an adapted version is being generated by the present instantiation of the 
adaptation algorithm. 

If the evaluation at step 5.2 indicates that the web content can fit into the display of 
the intended display device, and no transformation is required, then the transformation 

20 algorithm ends at step 5.3 and return TRUE for the function fits _page().. 

On. the contrary, if the evaluation at step 5.2 returns a negative, then processing 
proceeds to step 5.4 wherein an evaluation is performed to determine as to whether the 
counter i=1. It will be recalled here that when the algorithm is first started at step 5.1 the 
counter I is initialised to one, and hence the evaluation at step 5.4 returns a positive, and 

25 processing proceeds to step 5.6. Here, the first transformation in the form of font reduction 
is started, which takes the forms of steps 5.8 and 5.10. 

At step 5.8 the font size for all text in the web content to be adapted is set as 1, 
although in other embodiment other values may be chosen. Next, at step 5.10 the font 
typeface for all text in the web content is set as 'Verdana". These steps have the result of 

30 drastically reducing the size of any text objects in the web content. Following the steps 
processing proceeds to step 5.12, wherein the counter i is incremented by one, and then 
processing proceeds back to the evaluation at step 5.2 wherein an evaluation is performed 
to determine whether or not the transformed web content will now fit into the display of the 
intended display device. If this evaluation at step 5.2 returns a positive, i.e. the web content 

35 is now capable of being displayed on the intended display device, then the process 



WO 2005/033969 



25 



PCT/GB2004/004151 



proceeds to step 5.3 and ends. On the contrary, if further transformations are required then 
processing proceeds to step 5.4, wherein an evaluation is made as to whether the counter i 
Is equal to one. Here, as the count i was incremented at step 5.12 and is now equal to two, 
a negative result is returned and hence processing proceeds to the evaluation at step 5.14, 
5 which evaluates whether the counter i is equal to two. Here a positive value will be 
returned, whereupon processing will proceed to step 5.16. 

At step 5.16 an image reduction transformation is commenced. Within the image 
reduction transformation, first at step 5.18 a maximum possible reduction of the image is 
obtained. This is a hard coded value, for example 50%. Next, at step 5.20 an evaluation is 

10 made as to whether or not the maximum reduction value is greater than ten times the value 
of the counter r. It will be recalled here that at step 5.1 the value of the counter r was 
initialised at to zero, and hence on the first recursion the evaluation of step 5.20 will return a 
positive value. Here processing proceeds to step 5.22, wherein images within the web 
content are reduced by 10%. Processing then proceeds to step 5.24 wherein the counter r 

15 is incremented by one, and from there to step 5.26 wherein an evaluation is made as to 
whether or not r is equal to 5. On the first recursion r will have been incremented at step 
5.24 to take the value 1 only, and hence the evaluation of step 5.26 will return a negative 
value. In this case, processing proceeds directly back to step 5.2, wherein the evaluation as 
to whether or not the transformed content will fit into the display of the intended display 

20 device is undertaken. If this is the case then processing ends at step 5.3 although if it is not 
the case then processing proceeds via step 5.4 to step 5.14, wherein, because i has not yet 
been incremented again, a positive evaluation is returned, and the image reduction 
transformation of steps 5.18, 5.20, 5.22, 5.24 and 5.26 is applied once again. 

It will be seen from Figure 5 that the image reduction transformation can be applied 

25 up to five times, and each time it is applied the images are further reduced in size by 10% 
for each recursion, or by the maximum reduction value available, in the event that the 
maximum reduction available of the image is not greater than ten times the present value of 
r. In either event, however, the transformation is recursively applied five times, until the 
counter r =5. In this case, the evaluation of step 5.6 will then return a positive, whereupon 

30 processing will proceed to step 5.12, wherein the counter i is incremented. From step 5.12 
processing always proceeds back to step 5.2, wherein the evaluation as to whether or not 
the content will now fit into the display of the intended display device is undertaken. If the 
transformations already applied are sufficient, then this evaluation will return a positive 
value and processing will end at step 5.3. If the transformations already applied are not 
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sufficient, however, and further transformations are required, then processing will proceed 
via step 5.4 and now also via step 5.1 5 (by virtue of i now being equal to 3) to step 5.30. 

Here, an evaluation is made as to whether or not the counter i equals 3, and if so 
processing proceeds to step 5.32, wherein the control object reduction transformation is 
5 commenced by proceeding to step 5.34. 

At step 5.34 a ratio is obtained of the default screen size for the web content, and 
the actual screen size of the intended display device. Based on this ratio, at step 5.36 a 
size of each control object is calculated based on the ratio, by applying the ratio to the 
default size. Then, at step 5.38 an evaluation is performed at to whether or not the 
10 calculated size for each control object is less than the minimum allowable size for each 
object, and if not processing proceeds to step 5.42 wherein the control object sizes can be 
reduced based on the calculated ratio. If, however, the calculated size is less than the 
allowable minimum size of each control object, then processing proceeds to step 5.40, 
wherein the size of the control objects in the web content is reduced based on the allowable 
15 minimum size. The allowable minimum size is predetermined in advance. 

After either step 5.40 or step 5.42, processing proceeds to step 5.12 wherein the 
counter i is incremented, and thereafter to step 5.2 wherein the evaluation as to whether or 
not the transformed content will now fit into the display of the intended display device is 
performed. 

20 Assuming the evaluation of step 5.2 returns a negative, the counter i is now equal 

to the value 4, and hence processing proceeds via step 5.4, step 5.14, and step 5.30, to 
step 5.44 wherein the evaluation that i equals 4 returns a positive value. This has the result 
of causing processing to proceed to step 5.46, wherein the space removal transformation is 
commenced. 

25 This transformation relates to looking at object tags within the web content, and 

removing those objects which have particular tags and/or which meet other certain 
conditions. Therefore, at step 5.48, those objects which have tag <BR> and which are the 
first child and the last child of objects with tags <TD> and <DIV> are removed. Next, at step 
5.50, those objects with tag <BR> and which are the sibling of objects with tag <Table> are 

30 also removed, and then, at step 5.52 any continuous blank spaces within the web content 
display objects are reduced to a single space, and correspondingly, at step 5.54 any 
continuous breaks within the web content display objects are reduced to one. Finally, at 
step 5.56 the cell padding, and cell spacing values of any <table> objects are reduced to 
zero. The result of the space removal transformation is to reduce blank space in the web 

35 content to an absolute minimum. 
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Following step 5.56 processing proceeds to step 5.12, wherein the counter i is 
incremented to 5. The evaluation at step 5.2 is then performed to determine whether or not 
the transformed content will now fit into the display of the intended display device, and if so 
processing then ends at step 5.3. If not, however, processing would proceed via step 5.4, 
5 step 5.14, step 5.30 and step 5.44, to step 5.58, wherein the evaluation that i is equal to 5 
would return a positive. Thereafter at step 5.60 the line removal transformation is applied, 
which acts at step 5.62 to remove all display objects with a <HR> tag. This has essentially 
the same function as the fourth transformation previously applied, i.e. to reduce blank 
space. 

10 After step 5.62, processing proceeds to step 5.12 once again, wherein the counter i 

is incremented. The evaluation of step 5.2 is then performed once again, and assuming 
that it produces a negative result processing will proceed to step 5.64 via steps 5.4, 5.14, 
5.30, 5.44, and 5.58. The evaluation at step 5.64 will result in a positive result, as i has 
been incremented to 6. 

15 Therefore, following step 5.64 processing proceeds to step 5.66, wherein the 

decoration text removal transformation is commenced. This is performed at step 5.68, 
wherein text which had its function detected by the content analysis module 20 as being for 
decorative purposes is removed from the web content. 

Following step 5.68 processing proceeds to step 5.12 wherein the counter i is 

20 incremented, and thereafter to the evaluation at step 5.2 as to whether or not the 
transformed content will now fit into the display of the intended display device. Assuming 
this is not the case, processing proceeds by the respective evaluations of steps 5.4, 5.14, 
5.30, 5.44, 5.58, and 5.64 to step 5.70, and therein as the counter i now has a value of 7 a 
positive result is returned. This causes processing to proceed to step 5.72, wherein the 

25 decoration image removal transformation is commenced. At step 5.74 those images or 
objects whose function was detected by the content analysis module 20 as been decoration 
are removed. Thus images which do not contribute to the real semantic content of the web 
content are removed. 

Following step 5.74, processing proceeds once again to step 5.12 wherein the 

30 counter i is incremented. Thereafter the evaluation at step 5.2 is performed as to whether 
or not the now transformed content will fit into the display of the intended display device, 
and assuming that this evaluation returns a negative value, processing proceeds via the 
respective evaluations of step 5.4, step 5.14, step 5.30, step 5.44, step 5.58, step 5.64, and 
step 5.70 to step 5.76, wherein an evaluation is performed as to whether i is now equal to 8. 

35 As this evaluation will return a positive result, processing proceeds to step 5.78 wherein the 
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image replacement transformation is commenced. This starts at step 5.80, wherein, for 
each image display object an evaluation is performed as to whether or not the image has 
alternative text. If this is the case, then processing proceeds to step 5.82 wherein a further 
evaluation is performed as to whether or not the total pixel size of the alternative text to the 
5 image is smaller than the image itself. Only if this is the case will the image be replaced 
with the alternative text. There is clearly little point in replacing an image with alternative 
text, if that text will take up more space than the image. Following the replacement at step 
5.84 processing proceeds to step 5.12. Similarly, if either of the evaluations of step 5.80 or 
step 5.82 return a negative value i.e. an image does not have alternative text, or the 

10 alternative text is not smaller than the existing image size, then processing similarly 
proceeds to 5.12. It should be pointed out here that the image transformation depicted in 
Figure 5 is applied to each image in turn, before processing proceeds to step 5.12 and the 
counter i is incremented. Moreover, this processing of multiple objects in the web content 
applies to each of the transformations previously described, in that each transformation is 

15 applied to every relevant object in the web content before the counter i allowing the next 
transformation to be applied is incremented. 

At step 5.12, once again the counter i is incremented, such that in this case it now 
takes the value 9. Therefore, when processing proceeds to the evaluation at step 5.2, the 
alternative condition of that evaluation that i is greater than 8 is now met, and hence the 

20 transformation algorithm must therefore end. 

It will therefore be seen from the above description that the transformation 
algorithm acts to apply each transformation to the display objects in the web content in turn, 
and evaluate after the application of each transformation as to whether or not the 
transformed web content is capable of being displayed on the display of the intended 

25 display device. If this is the case then no further transformations are applied, and the 
function returns TRUE to fitsjpageQ. 

After the adaptation process is done, i.e. after the adaptation algorithm of Figure 6 
has ended, a different version of web content will have been generated for a particular client 

30 capability profile. As there are a plurality of client capability profiles, however, the algorithms 
must be run repeatedly to generate an adapted web content version for each client 
capability profile. Following this (i.e. after all the versions have been created) the 
Adaptation module creates the profile Ids for the versions created based on the client 
capability profiles, and stores the adapted versions and Ids in the Content Cache. The 

35 logical relationship of the profile ids and physical adapted content is in the form of a 
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database structure cross reference link. These versions of adapted content are then ready 
to be retrieved and delivered to an end user upon request. 

Thus, in the above described mode of operation, the system according to the 
embodiment of the invention acts to generate multiple adapted versions of the original web 
5 content in advance of user requests therefor, each version being for a particular intended 
display device with known and specified characteristics. 

As mentioned previously, however, the system may also operate in a web server 
capacity. This mode of operation will be described next. 

Imagine that the system is acting as a web server and is connected to the Internet! 

10 The server receives an http request for web content from an end user device 1. That http 
request is first routed to the client capability discovery module 12, which acts to determine 
the set of display characteristics of the end user device 1, such as, for example screen size, 
colour depth, browser type, network connection, etc. 

The client capability discovery module detects device capabilities based on existing 

15 standards such as those put forward by M3I (please refer to Current Technologies for 
Device Independent, Mark H Butler, HP Labs Technical Report HPL-2001-83 4 April 2001, 
referenced previously, the relevant contents of which necessary for a full understanding of 
the present invention being incorporated herein by reference). At the present time most 
internet browsers contain end-users' device information such as browser type and version, 

20 IP address, screen resolution etc in the initial request sent to the web server. An end-user's 
device will start communicating with the server when the end-user enters a URL through a 
web browser. To get the end-user device information, client capability discovery module 12 
uses a simple Javascript™ to retrieve the client capability information sent from the end- 
user's browser and passes the information to the server through a Java servlet program. 

25 There follows below a sample of the Javascript™ program which get and post end-user 
device information to the server through a Java® Servlet called "clientprofile": 

<script language^" JavaScript "> 
function getdoviceinf o ( ) { 
30 document, f ormclient .pageUpdate . value = document . las tModi fled ; 

document. f ormcl lent .aval lHeight . value » screen. aval lHeight; 

document. f ormclient. aval lWidth. value = screen. aval lWidth; 

document . f ormclient .buff erDepth. value = screen. bufferDepth; 

document. f ormcl ient . colorDepth. value - screen . colorDepth; 
35 document. f ormclient . fontSmoothingEnabled. value 

screen. font SmoothingBnabled; 

document. f ormclient. height. value o screen. height; 

document. f ormclient. width. value = screen. width; 

document, forme lien t. update Interval, value = screen, update Interval; 



document. f ormcl ient . javaEnab led. value = navigator . j avaEnabled () ; 
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document . f ormclient . appName .value- navigator . appName; 

document. f ormclient . appVersion. value - navigator .appVersion; 

document, f ormclient. cookieSnabled. value = navigator . cookieEnabled ; 

document. f ormclient. cpuClass. value a navigator .cpuClass ; 
5 document . f ormclient. mimeTypes. value a navigator .mimeTypes ; 

document, f ormclient. appCodeName. value = navigator . appCodeName ; 

document .f ormclient. platform, value - navigator .platform ; 

document . f ormclient .opsProfile. value = navigator . opsPro file ; 

document. formcli en t.plugins. value = navigator .plugins ; 
1 0 document . f ormclient . sye temLanguage . value ^navigator . eye temLanguage ; 

document . forme lien t . user Agent . value = navigator .userAgent ; 

document . f ormclient . userLanguage . value = navigator . user Language ; 

document . f ormclient .user Profile. value - navigator .userProfile ; 

document . f ormclient. actions "clientprof ile" ; 
15 document, f ormclient. submit () ; 

} 

</script> 



Having determined the set of client characteristics of the end user device 1, the 
20 client capability discovery module 12 then passes the set of characteristics determined 
thereby to the decision module 14, which acts to compare the end user device 
characteristics with the set of client capability profiles stored in the profile server 26. If the 
decision module 14 can match the set of end user device characteristics with one of the 
client capability profiles, then the decision module accesses the content cache 10 which 
25 stores the different versions of adapted content using the profile ID of the client capability 
profile which matched to the end user device characteristics as an index thereto. The 
adapted version of the web content which is indexed to the profile ID of the matching client 
capability profile is then retrieved from the content cache 10, and supplied via the network 
to the end user device 1 . Thus, in this mode of operation, the system is able to match end 
30 user device display characteristics with a set of predefined device characteristics, so as to 
determine the appropriate pre-generated adapted version of the web content to send to the 
end user device. 

As previously mentioned above, the system also provides a further mode of 
operation, which combines the operations provided by the previously described modes. 

35 Here, when an end user device 1 makes a request for web content, as before the client 
capability discovery module 12 acts to determine the display characteristics thereof, which 
are then passed to the decision module 14. The decision module 14 then attempts to 
match the capabilities of the end user device 1 with the client capability stored in the profile 
server 26, and if a match is found then the appropriate adapted version of the web content 

40 is retrieved from the content cache 10, and passed to the end user device 1 over the 
network. If, however, no match can be made, then the decision module 14 acts to operate 
the adaptation module 16, by passing the details of the end user device 1 relating to the 
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characteristics as determined by the client capability discovery module 12 to the adaptation 
module 16. The adaptation module 16 then creates a new client capability profile which is 
stored in the profile server 26 corresponding to the capabilities of the end user device 1 , 
and also starts its operation in exactly the same manner as previously described when pre- 
5 generating adapted versions of the web content, so as to create a new adapted version of 
the web content adapted specifically for the end user device 1 . That is, the adaptation 
module 16 causes the content analysis module 20 to operate, which analyses the web 
content, allowing the adaptation module to run the adaptation algorithm so as to generate a 
new adapted version of the web content specifically for the end user device 1 . The adapted 

10 web content is then fed back to the decision module, which forwards it over the network to 
the end user device 1. In addition the new adapted web content is also stored in the content 
cache 10 for future use by similar end user devices to the end user device 1, if required. 
Therefore, in this further mode, new versions of adapted web content can be created 
dynamically in response to a user request but are also then stored so as to be used to 

1 5 service future user requests if required. 

In addition to the modes of operation described above, the system also provides 
the customisation module 24. This is merely a front end to allow web authors to browse the 
various adapted versions of the web content stored in the content cache, so as to make 
further refinements or improvements thereto if required. In view of this functionality, no 

20 further discussion of the customisation module 24 will be undertaken. 

In conclusion, therefore, the system allows for different versions of web content to be 
created in advance of user requests therefor, such that user requests can then be serviced 
by matching the display characteristics of the end user device to the pre-created versions, 
and hence allowing a response to be generated quickly, and with very little computing 

25 intensity. Additionally, if required, new versions of adapted web content can be dynamically 
created to match a specific end user device requesting the web content, and the 
dynamically created adapted web content is then also stored for later use in servicing future 
requests from similar end user devices. 

It is understood that in the specific embodiment described herein, particularly with 

30 reference to the adaptation process of Figures 5 and 6, the procedure involved an iterative 
process which worked its way through the analysed web content (the XML tree), splitting 
the content and transforming it as necessary to reduce it in size to fit the display device. 
However, an alternative embodiment is also envisaged in which the procedure would be 
modified so as to initially reduce the whole content down to its smallest possible size, before 

35 splitting the content and then transforming by rescaling upwards again to increase the size 
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of the content to fit the display size. Upon rescaling the content upwards, it might then be 
necessary to re-split the content so as to better distribute it between pages. This procedure 
would therefore also involve iteratively splitting and transforming, but the step 'of 
determining whether the size of the content is suitable for display on the device might 
5 involve calculating whether an unacceptably large area of white space would be displayed 
on the device. 

The grouping/clustering pattern algorithm thus groups the web-page portion 
objects into clusters and determines the relationships between the clusters. The grouping 
and the relationship affect how the web-page content is displayed over several smaller 
10 pages of content on smaller screen devices. One method of determining which clusters 
should be in which page of the set of smaller pages of content uses the grouping/clustering 
pattern algorithm and further depends on the following predetermined parameter values: 

the maximum acceptable number (in total) of pixels calculated within the clusters to 
be selected; 

15 the acceptable white space for a splitted page (which may be experimentally 

determined); 

the acceptable splitted page vertical length (which may be an experimentally 
determined parameter); and 

the acceptable splitted page horizontal length (which may be an experimentally 
20 determined parameter); 

By adopting a cyclical (i.e. iterative or recursive) approach to dividing the content of 
a web-page arranged for display on a device having a display area of a first predetermined 
size into a plurality of pages of content for display on one or more other devices, each of the 
other devices capable of having differing display areas, the formats used to present the 
25 content on each device are relatively consistent. All displays showing pages containing 
content derived from the original web-page should therefore be able to share a consistent 
format. 

Unless the context clearly requires otherwise, throughout the description and the 
claims, the words "comprise", "comprising" and the like are to be construed in an inclusive 
30 as opposed to an exclusive or exhaustive sense; that is to say, in the sense of "including, 
but not limited to". 

The text of the abstract is repeated below as part of the description: 
An apparatus and method for adapting web page content are described. The 
35 adaptation of web page content for display on smaller intended display devices often 



WO 2005/033969 



33 



PCT/GB2004/004151 



requires the splitting of the content over a number of smaller pages. The apparatus and 
method relate to a procedure which integrates the process of splitting the content with 
applying transformations (for example, reducing the font size, images, etc) so as to optimise 
this process. The procedure is carried out systematically over the entire web page content, 
5 recursively splitting the content into smaller and smaller portions whilst simultaneously 
alternating this with various transformations so as to minimise the amount of white space 
visible on the smaller pages. Additionally, the preferred embodiment also tracks the 
transformations which have been applied to the objects and ensures consistency by 
applying them later to any similar objects. 



